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1.0 INTRODUCTION 


For a small class of reliability models, this report shows how to just look at 
the model and write down a convenient approximation for the answer. 

The models considered are appropriate for redundant reconfigurable digital 
equipment that operates for a short period of time without maintenance and that 
collects only permanent faults. The models are pure death Markov processes where 
all the fault occurrence rates are low and all the system recovery rates are high. 

A discussion of the numerical bounds for the parameters is in the text. For such a 
model the method gives a formula in terms of fault rates, recovery rates, and 
operating time. The approximation formulas are simple enough that a pocket calcu- 
lator yields reliability estimates and an examination shows the relative influence 
on reliability of each of the parameters. The simple formulas have easy partial 
derivatives that give the change in reliability with respect to a change in any 
parameter. 

The first half of the report describes the approximation procedure and pre- 
sents several examples. The interested reader can sample the illustrative computa- 
tions until he feels comfortable with the methods. Because there is no analysis of 
error bounds, the examples also compare the approximate solutions to exact numeri- 
cal solutions to establish confidence in the approximation. 

To avoid the formulas appearing completely mysterious, the section on paths in 
pure death processes derives the approximations for two short paths. Unfortunate- 
ly, the inductive procedure suggested by these derivations proved too hard for the 
author. After several induction steps to guess the formula, material from the 
theory of matrix differential equations is used to show that the obvious answer is 
the correct answer. The explanatory material in the sections on paths shows the 
first two induction steps while the section on matrix series in the second part 
presents the material needed to tackle the general case. 

The second half of the report contains all the interesting material. The 
approximation is actually derived from an exact solution and the first two sections 
in the second half give the algebraic and analytical parts of the derivation for 
this exact solution. Two of the three elements that generate the approximation 



formulas from the exact solution are easy: the exponential of a large negative 

number is nearly zero, and a very large number plus or minus a very small number is 
nearly equal to the very large number. The third element is the approximation of a 
multinomial Taylor series, where all the terms are small, by the first nonzero term 
in the series. A separate section presents the matrix Taylor series solution anci 
identifies its first nonzero term. The last section derives the approximation 
formula from the exact solution in a bookkeeping proof — the only challenge is 
keeping the notation straight. 
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PART I 
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The probability of being in state 4 at time T is the probability of 
traversing the first path by time T. Even though the second and third paths have 
some states in common, they are distinct paths. The probability of being in state 
7 by time T is the probability of traversing the first path to state 7 by time T 
plus the probability of traversing the second path to state 7 by time T. In all 
cases, the probability of traversing a path by a certain time includes the 
probability of events following that path. 

Without attaching any meaning to the Markov process, the probabilities of 
traversing the path to state 4 and the first path to state 7 will be estimated. 

The estimations involve computing the probability of going from one state to the 
next on the path and computing the probability of the transition occurring within 
the specified time. 

The X's are low fault occurrence rates, the p and 6's fast system 
recovery rates. 

To begin, consider 
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Given the system is in state 3 at time t 0 the probabilities of being in state 4 
and state 6 by time tj are, respectively. 



*3 

X 3 + <S 2 



+ « 2 )(ti 




6 ? ,, "^3 + 5 2 )(*1 

X 3 + s 2 



Of course events will go from state 3 to one of the states 4 or 6, but not to 
both. In these equations the probability of going to state 4 or 6 is given by the 
first factor in the expression on the right. The probability of having made the 
transition by time t x - t 0 is given by the second factor in the expression, which 
is the same in both equations. Since S 2 is large, the second factor in both 

expressions rapidly approaches 1 as t x increases. Hence, the holding time in state 
3 is negligible, and 


P 4|3 “ x 3 X + 6 2 * ^ 

P 6|3 - ff-T67 " 1 

whefe the second approximation comes from 

X 3 + 6 2 ■ 6 2 • 

To continue working backwards on the path from state 1 to state 4, consider 
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Similar reasoning gives 


3 1 2 p + 6 X 


> M 2J 

52 P + «! 

5 I - « — p ■ 

8 1 2 p + 6^ 


and the holding time In state 2 Is negligible. 


By independence, the probability of going from state 2 to state 4 is 


( — 2a — ) (h.\ . 
v p + k s 2 


Because of the large transition rates, the transition time from state 2 to state 4 
is negligible. Hence, the computation of the probability of going from state 1 to 
state 4 by time T can be finished by multiplying the expression above and the 
probability of going from state 1 to state 2 by time T. To this end, consider 


\ 


and get 




h 

*1 + *7 


(1 


-(Xi + X 7 )T 

e ) . 
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Since (*! + A 7 )T Is small, the approximation 


■(*1 + ^7 ) T 

1 - e 


Ui + X 7 )T 


gives 

P 2|l (T | 0) " (rr*x7> ftl + »»)T - XlT . 

Notice that the approximation does not Involve the low rate leading off the path. 

Combining all the material above gives the probability of being in state 4 by 
time T as 


P«(T) - (*,T) 



X i A?A 3 T 
$2 (P + $1 ) 


Next, the probability of going from state 1 to state 7 by time T along the 

path 


will be estimated to show what happens when there is a sequence of low rate 
transitions. 

The transitions from state 2 to state 5 and from state 6 to state 7 take a 
negligible amount of time and contribute a factor of 
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Collect the transitions from state 1 to state 2 and from state 5 to state 6 to form 
the diagram 



-(Ai + A7 )T 

p c|a< t I°> ' XlXl * 1 (x 4 '-r ir- x;-- ijH-Xi - x 7 ) 


-(x* t X e )T 

. e 

(A X + A 7 - A 4 - A 8 )(-A 4 - A 8 ) 

. 1 

(Ai + A 7 )(A 4 + A 8 ) } 


X b 

(Ai + A7 ) (A 4 + A 8 ) (Aj + A7 - A 4 - A 8 ) 


-(*1 +A 7 )T -(A 4 + A 8 )T 

x { (*4 + ^ 8 ) e ”(*1 + ^ 7 )® 


+ (Aj + A 7 - A 4 - A e )} 


Since (Aj + A 7 )T and (A 4 + A 8 )T are small, the approximations 


-(Ai + A 7 )T /. x_\ 2 t 2 

1 - e - (Ai + A 7 )T - a 7 1 


~(a 4 + i\ + Xo1 2 t 2 

1 - e - (a 4 + a 8 )T - ^ + . * b. ) . L . 


9 


can be used which gives 


P C|A< t |°> “ T r. T xn VT, - >e')A + > 7 - A, - A„) 

X { (Xi + X 7 ) [(X 4 + A 8 )T - + \ 7 ) 2 t2 ] } 


-(H + h) [(*1 + X 7 )T - (X 1 + X 7) 2 T 2 j j 

= X, At. T 2 

^1 ■*" X 7 ) (X 4 + Xg ) (X ^ + X 7 - X 4 — X 8 ) 

x {-(X L + X 7 )(X 4 + X 8 ) 2 + (X 4 + X 8 )(X! + X 7 ) 2 } 

X, X u T 2 
2 


Notice that the terms linear in T vanish, and that once again the low rates 
leading off the path do not appear in the approximation. The expressions above 
combine to give the probability of traversing the path by time T as approximately 


/Ai Xu i 


o 


p + 6 


-) (^-i 


The last derivation ends the illustrative development, and it's now possible 
to guess the general formulas presented in the next section although two comments 
are in order before proceeding. First, since the low rates that lead off the path 
do not appear in the approximation, these low rates can be adjusted to insure that 
no zeros appear in the denominators of the exact solution. Second, the 
approximation formulas are given for binary nodes with one rate for the transition 
on the path and one rate for the transition off the path. Any complex node can be 
changed to a binary node by adding the rates that lead off the path. 
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3.0 DESCRIPTION OF THE APPROXIMATION METHOD 


A Markov process model of redundant reconfigurable electronic equipment with 
permanent faults consists of two types of transition rates — low rates for 
component failure and high rates for system recovery. Any path through the Markov 
model from the initial state to an absorbing state such as 



has four classes of transitions: 

0-0 

Y 

T 

a-o 


a^o 

Y 


A « 1 , y « 1 


A « 1 , p >> 1 


Y « 1 , 6 » 1 
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In the diagrams above, A and 6 are special cases of the a's. They represent 
transitions that stay in the chosen path. The transitions y and P are special 
cases of the p’s. They represent transitions that lead off the path. 

Since the arrival time at the end of the path is the sum of waiting time for 
independent processes, the path can be rearranged. 


To get an approximation for the probability of traversing the path by time T, 
first collect all transitions of the class 


OK) 

Y 

to get, supposing there are k of them. 



*1 



This group contributes a factor of 


X « 1 , Y « 1 



Ai A2 • .. A^ T^ 

FI 


12 


to the probability of traversing the path by time T. 
Any transition of the class 

CH— O 

P 

* 

V 

contributes a factor of 

X 

p 

Any transition of the class 

Ch-O 

y 

v 

contributes a factor of 1. 

Any transition of the class 

Cm — O • » 1 • 

p 

contributes a factor of 

5 


, p » 1 


Y « 1 


p » 1 
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At the moment there is no error analysis, but the approximations appear to be 
accurate for the parameter bounds 

1 <. T < 10 

XT _< 10- 2 all X's 

YT < 10- 2 all y’s 

6 > 10 2 all 6 1 s 

p > 10 2 all p's 

The next sections compare the approximation to a numerical solution for a variety 
of reliability models. These sections assume familiarity with Markov models of 
fault tolerant computers. The reference on reliable system design gives an 
engineering presentation of this material. 
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4.0 APPLYING THE FORMULA 


To apply the approximation method, It is necessary to Identify the paths to an 
absorbing state and then separate the states on a path into two classes— the states 
with at least one high exiting rate and the states with all low exiting rates. The 
system spends a negligible amount of time in states that have at least one high 
exiting rate, and these states can be considered individually. The system spends 
an appreciable amount of time in states that have only low exiting rates, and these 
states must be considered as a group. 

As an example consider state 7 In the diagram below 
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where the transitions, respectively, contribute factors of 


5AT, 


4A 


, 3A 
1 » £ 


which gives the contributions from the first path as 

60 A 3 T 
6 1 6 3 


Rearrange the second path to state 7 which is 


as 




4A 


© 
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where the transitions, respectively, contribute factors of 
20 X 2 T 2 , 3A 

^ u «r 

which gives the contribution from the second path as 

30 X 3 T 2 
63 * 

Since the paths are distinct, they are disjoint events. The probability of being 
in state 7 by time T given the system is in state 1 at time 0 is 

60 X 3 T 30 X 3 T 2 

«1 « 3 « 3 * 
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Pg(T) = 


9A 2 T 2 


2 

In the numerical comparisons note that if 
A = 10- 2 
T = 1 


then 


3AT > 10- 2 . 

The numerical comparisons for this example, and for later examples, do not adhere 

strictly to the parameter bounds mentioned in the section that described the 
formulas. 

For the examples in this and the next three sections, the model is followed by 
the approximation formulas and then tables comparing the approximate and exact 
solutions for parameter values that are close to the parameter bounds. 
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STATE 


EXACT 


FORMULA 


^ = io - 2 

) = 10 2 ; e 


^ = io - 2 
) = 10 2 ; e 


^ = io - 2 

> = 10 3 ; e 


V = io - 2 
> = 10 3 ; e 



1.16 

1.64 

4.07 

6.44 

9.30 

4.22 

6.44 

9.30 

4.22 

1.18 

1.75 

4.38 


X 


X 


10- 5 

10- 7 

io - 4 

10- 6 

10- 8 

IO -4 

io - 6 

10- 8 

io - 4 

io - 6 

10- 8 

io - 4 


1.20 X 10- 5 

1.80 x IO- 7 

4.50 x IO- 4 

6.60 x IO- 6 

9.90 x 10- 8 
4.50 x IO- 4 
6.60 x IO" 6 
9.90 x IO- 8 
4.50 x 10- 4 

1.20 x IO- 6 
1.80 x 10- 8 

4.50 x IO" 4 



















EXACT 


FORMULA 




1.18 x 10- 6 

1.20 x 10“ 6 

1.75 x 10- 8 

1.80 x 10- 8 

-± 

1 

o 
»— 1 

X 

00 

CO 

• 

4.50 x 10- 4 

1.18 x 10- 7 

1.20 x 10- 7 

1.76 x 10- 9 

1.80 x 10- 9 

4.41 x 10' 4 

4.50 x 10- 4 

1.20 x 10- 8 

1.20 x 10- 8 

1.78 x 10- 11 

1.80 x 10- 11 

4.46 x 10- 6 

4.50 x 10“ 6 

1.20 x 10- 9 

1.20 x 10- 9 

1.80 x 10- 12 

1.80 x 10- 12 

4.49 x 10- 6 

4.50 x 10- 6 


















The approximations are 


P 3 CO 

P 6 CO 

p 8 (t) 

Pll(T) 
. Pl3(T) 

Pis(T) 


= fo 2 T 
6 

= 9\ 3 T 2 
6 

= 3X 3 T 3 
2 

= 3X 2 u T 2 
6 

3X 2 u T 2 
2 

= X 2 » T 2 


+ 


6 X 2 u T 
6 2 

6X 2 y T 
6 2 

3X 2 u T 2 


2 


+ 
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STATE 


EXACT 


FORMULA 


T = 1 


A = 10- 2 

U = 10- 3 
6 = 10 2 


T = 1 
A = 10- 3 

U = 10- 4 
6 = 10 3 


T = 10 

A = 10- 3 
V = 10- 4 
6 = 10 2 


r = 10 
> = io - 4 

I = io - 5 
i = IO 3 


3 

6 

8 

11 

13 

15 

3 

6 

8 

11 

13 

15 

3 

6 

8 

11 

13 

15 

3 

6 

8 

11 

13 

15 


5.85 x 10- 6 
8.47 x IO" 8 
1.39 x IO' 6 

2.94 x 10- 9 

2.88 x 10- 9 

4.77 x IO" 8 

5.98 x 10- 9 

8.95 x IO- 12 

1.49 x 10- 9 

2.99 x 10- 13 
2.99 x IO" 13 

4.98 x IO- 11 

5.90 x IO" 7 

8.78 x 10- 9 
1.46 x 10- 6 
2.94 x IO- 10 
2.93 x IO- 10 

4.90 x IO" 8 

5.99 x IO- 10 

8.98 x 10- 13 

1.50 x IO" 9 

2.99 x IO- 14 

2.99 x IO" 14 

4.99 x IO- 11 


6.00 x IO- 6 

9.00 x 10- 8 

1.50 x 10- 6 

3.06 x IO" 9 
3.06 x 10- 9 
5.15 x 10- 8 

6.00 x IO- 9 

9.00 x IO- 12 
1.50 x 10- 9 

3.01 x 10- 13 

3.01 x IO" 13 

5.02 x IO- 11 

6.00 x IO" 7 

9.00 x 10- 9 
1.50 x 10- 6 

3.01 x IO- 10 

3.01 x IO- 10 

5.02 x 10- 8 

6.00 x IO- 10 

9.00 x 10- 13 
1.50 x 10- 9 

3.00 x IO- 14 

3.00 x IO- 14 

5.00 x IO" 11 


















7.0 EXAMPLE: 


CRITICAL TRIPLE SIX-PLEX 


The Markov reliability model is 





TABLE V 


7 ; $2 = io 6 ; «3 = io 5 ; «•» = io 4 ; «s = io 3 ; $ 6 = 10 2 



8 1.79 x 10- 19 1.84 x IO- 19 

11 5.96 x IO- 14 6.18 x IO- 14 

14 2.86 x 10- 16 3.12 x 10- 16 

16 2.83 x 10- 15 3.15 x IO" 15 

r = 10 4 1.16 X 10- 19 1.20 X IO- 19 

8 1.74 x 10- 17 1.80 x IO" 17 

11 5.78 x IO- 11 6.02 x IO -11 

14 2.88 x IO- 12 3.01 x IO" 12 

16 2.89 x IO- 10 3.02 x IO" 10 










The approximations are 


PJT) 


P 8 (T) 


Pli(T) 


Pl%(T) 


120 X 3 T 
5 1 5 2 


180 X 4 T 2 360 X 1 * T 

6 3 6^ 63 64 


60 X** T 180 X 4 T 2 180 A 1 * T 2 + 360 X 1 * T 

fi 5 63 65 6l 65 63 65 


30 X 5 T 4 120 X s T 3 
$6 63 65 


120 X s T 3 + 360 X s T 2 

61 6g 5 ! 63 65 


3 X 5 T 5 


15 X 5 T 4 15 X 5 T 4 
5 3 61 


60 X s T 3 
6 1 6 3 


Pie(T) 


+ 



STATE 


EXACT 


FORMULA 


T = 1 

4 


00 


11 


14 


16 

T = 10 

4 


00 


11 


14 


16 


1.18 x 10- 12 

1.20 x 10- 12 

1.79 x 10- 19 

1.84 x 10- 19 

5.98 x 10- 17 

6.18 x 10- 17 

2.99 x 10- 21 

3.12 x 10- 21 

2.99 x 10- 15 

3.15 x 10- 15 

1.16 x 10- 11 

1.20 x 10- 11 

1.74 x 10- 17 

1.80 x 10- 17 

5.78 x 10- 14 

6.02 x 10- 14 

i — « 

o 

i-H 

X 

CT > 

CO 

• 

C\J 

3.01 x 10- 17 

2.91 x 10- 10 

3.02 x 10- 10 














The approximation formulas for the extended model are 


P 3 (T) = 


P 6 (T) = 


P 9 (T) = 


Pll(T) = 


Pl*(T) = 


Pu(T) 


Pl 7 (T) 


Pls(T) 


p 20 (t) 


20 X 2 T 
(« + P) 


30 X 3 6 T 2 
(6 + P ) 2 


20 X 4 <5 2 T 3 
(« + P) 3 


5 X 4 6 3 T 4 
2(5 * p) 3 


10 X 3 6 2 p T 3 

(« * e ) 3 


10 X 3 6 p T 3 
3(6 + p) 2 


15 X 3 p T 2 

(6 + p) 2 


5 x 3 p 6 T 3 

2(6 + p) 2 


15 X 2 p 2 T 2 

■STTTF 



STATE 


EXACT 


FORMULA 


T = 1 


r = 10 


1.80 x 10- 7 

1.82 x 10- 7 

o 

O 

r~i 

X 

CO 

CO 

• 

C\J 

2.48 x 10 - l ° 

1.38 x 10- 13 

1.50 x 10- 13 

1.68 x 10- 12 

1.88 x 10- 12 

6.40 x 10- 10 

7.51 x 10- 10 

2.60 x 10- 10 

2.75 x 10- 10 

1.19 x 10- 11 

1.24 x 10- 11 

1.95 x 10- 10 

2.07 x 10 “ l ° 

5.96 x 10- 8 

6.20 x 10- 8 

1.77 x 10- 6 

1.82 x 10- 6 

2.40 x 10- 8 

2.48 x 10- 8 

1.45 x 10- 10 

1.50 x 10- 10 

1.81 x 10- 8 

• 1.88 x 10- 8 

7.23 x 10- 7 

7.51 x 10“ 7 

2.67 x 10- 7 

2.75 x 10- 7 

1.20 x 10- 9 

1.24 x 10- 9 

2.01 x 10- 7 

2.07 x 10- 7 

6.01 * 10- 6 

6.20 x 10" 6 












STATE 

EXACT 

FORMULA 

3 

1.80 x 10- 7 

1.82 x 10- 7 

6 

2.38 x 10- 11 

2.48 x 10- 11 

9 

1.38 x 10- 15 

1.50 x 10- 15 

11 

1.68 x 10- 15 

1.88 x 10- 15 

12 

6.40 x 10- 11 

7.51 x 10- 11 

14 

ro 

• 

a\ 

o 

X 

H-* 

o 

1 

H 

o 

2.75 x 10- 10 

17 

1.19 x 10- 10 

1.24 x 10- l ° 

19 

1.95 x 10- 10 

2.07 x 10- 10 

20 

5.96 x 10- 6 

6.20 x 10- 6 

3 

1.77 x 10- 6 

1.82 x 10- 6 

6 

2.40 x 10- 9 

2.48 x 10- 9 

9 

1.45 x 10- 12 

1.50 x 10- 12 

11 

1.81 x 10- 11 

1.88 x 10- 11 

12 

7.23 x 10- 8 

7.51 x 10- 8 

14 

2.67 x 10- 7 

2.75 x 10- 7 

17 

1.20 x 10- 8 

1.24 x 10- 8 

19 

2.01 x 10- 7 

2.07 x 10- 7 

20 

6.01 x IQ- 4 

6.20 * 10- 4 


20 
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9.0 ALGEBRAIC RESULT FOR THE EXACT SOLUTION 


Lemma 


The following technical 

If a. * a. for 
i J 


result is used in the next section, 
i * j, then 


i 1 = 1 

i-1 k+1 k 

n (a. - a.) n (a. - a. .) 

j=l J 1 j=l J k+1 
j*i 


Proof 

The proof is by induction. Only the induction step is shown. 
Let 


k 

D = Z 
i=l 


1 


k+1 

n (a . 
j=i J 
j*l 


n (a, - a. . . ) 


.“j - u k+l' 


By the induction hypothesis. 


" (a j - <W 


1 _ 1 

W ‘ a k+l ^ k 


j=l 


n (a. - a k+1 ) 


j=2 


TO i=2 k?r 


n (a. - 

j=2 J 

j*i 


a i) 
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Hence, 


D = 


Tc+I 
n (a. 
3=2 


J a l } 


+ E 
i=2 


7+1 
n (a. 
j=l J 


- a i> 


i : i 

^ a l " a k+l) i-2 ^ 


n (aj - a.) 


j=2 

j*i 


k+1 

n (a. - a,) 

j =2 3 1 


k 

+ E [ 
i=2 


(a, - 


1 

£+1 

a.) n (a. 

1 j=2 J 

j*i 


- a.) (a. 


k+1 

a k + i> / =2 ‘ a j 

j*i 


a,) 


k+1 


n 

3=2 

< a j - a i> 

k 


+ E 

[ 

i=2 

{a 1 - a 


1 


a, - 


a k+l ’ a l + a i 


k+1 

a k+l^ . n =2 < a j - a i> 


] 


k+1 

n (a. - a.) 
j=2 J A 


k 

^ [ 

i=2 


^ a k+l “ a i ^ 


(a i - a i )(a i - a k + i )(a k+i - a i> " < a j 

J 


T+r 

n 

j=2 


a i) 
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k+1 

n (a. - a.) 
j=2 J 1 


k 

E 

0=2 


(a l - W j”j (a j 
J>1 


a i ) 


1 t- 1 


la M ' a l> 1 k 


n (a. - a. ) 


k 

+ E 
i=2 


0=2 


j 


n (a. 

0=1 J 


a i> 


Apply the induction hypothesis to the second term inside the brackets to get 


D = 


U k + 1 - a l } ^ 


H — L 


3 


n (a. - a.) n (a. - a.) 

0*2 J 1 0=2 J 1 


= 0 


and the lemma is proved. 
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10.0 DERIVATION OF THE EXACT SOLUTION 


Theorem If a.. + 0. * + 0^ for i * j, then the Markov process 


dp-© 


°2 




3l 


32 


n-1 


with the initial conditions 


P^O) = 1 


Pj(0) = P 3 (0) = ... = P n (0) = 0 


has the solution 


PpU) = a i ••• a n _i ^ — 


(a^ + 0^ )t 


n (a. +0. - a. - 0.) 


j = l 
j* i 


J "r 


Proof 


The proof is by induction. Only the induction step is shown. 


The set of differential equations for a Markov process gives 


W - Vl P n-l (t) - («„ * »„> p „(‘) 


or 


(a + 0 )t (o + 0 )t 

[ e " " P n (t)]' . Vl e " ■ P n . x (t) 
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By the induction hypothesis. 


(« n + e n )t 

[ e n n P n (t)]' 


a} ... a 


n-1 


n-1 

z 

i=l 


(a + 0 
' n n 
e 

n-1 

n (a • + B 

j=l J 
j*i 


Hence, 


P n (t) = c e 


-(<*„+ Bjt 


n n - 


n-1 

+ ai . . • a - E 
"- 1 in 


(a i + B i 


n 

n (a . + 0 . - 
j=l J J 
j*i 


By the initial conditions 


-«i 


n-1 


n-1 

z 

i=l 


n 

n (a. + 0. 

j=l J J 
J>i 


- a. - 


»i> 


By the previous technical lemma, 


C = oj 


a n-l n-1 

n (a . + 0 . - a - B) 
J J n p n' 


Hence, 


p„(t) ■ «i 


n 

z 

i=l 


-(ct i + & i )t 


n 

n (o . + 0 . - a. - 0. ) 

j=l J J 1 1 

j* i 


and the theorem is proved 



11.0 THE MATRIX TAYLOR SERIES 


Recall that the set of linear differential equations 


Pl'(t) 


a ll a 12 

... a ln 


Pi(t) 

p 2 '(t) 


a 21 a 22 

... a 2n 


p 2 (t) 

• 

• 

p„ : (t) 


• • 

• • 

• • 

a n a„ 

n l n 2 

• 

• 

• 

• • • ^ 

nn 


• 

• 

— — 


— 







with the initial conditions 


Pi(0) 


C 1 

P 2 (0) 


c 2 

• 


• 

• 


• 

• 


• 

e„(o> 


c 

n 


has the solution 


pi(t) 


c i 

p 2 (t) 

At 

c 2 

• 

= e 

• 

• 


• 

• 


• 

p„(‘) 


c n 
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where 



with the initial conditions 

Pi (0) = 1 

p 2 (0) = ... = P n (0) * 0 , 

the first nonzero term of P n (t ) in the matrix series expansion is 
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Proof 


The coefficient matrix of the set of linear differential equations for the 
Markov process is 

-(*1 + Yi ) 

\l -(X 2 + Y2) 

A 2 • 

A = 

-(Vl +Y n-1> 

X n-1 0 


with all the entries not on the diagonal or subdiagonal being zero. 


Cii 

denote the entry in row n and column 1 of the matrix M. Now 


Pl(t) 


1 

p 2 (t) 

At 

0 

• 

= e 

• 

• 


• 

• 


• 

p„(t) 


0 


which means 



Since 



0 0 _< k < n-1 

X j X 2 • • • X n ^ k - n-1 


the theorem is proved 



12.0 DERIVATION OF THE APPROXIMATION FORMULA 


Given a pure death Markov process place any path of length n that goes from 
the initial state to a death state in the form given on the next page where 

1 1 n l 1 n 2 1 n 3 1 n 4 = n 
and 

X i < < 1 all i 

Y i < < 1 all i 

6. > > 1 all i 

p. > > 1 all i 

Let 


( X . + p . 
’ ’ 

{ i + *i 

6. + p. 

r 


1 i j <. n i 

n i + 1 i. i i. n 2 

n 2 + 1 i <. n 3 

n 3 + 1 £ i £ n 4 
i = n 4 + 1 


Without loss of generality assume aj * aj if i * j. 
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The exact solution is 


P n*l< t > 


ni n 2 n^ n 4 

nx. n 6. n «. n \i 

i=l 0 = 0 !+! J k=n 2 +l *=n 3 +l 


* { 


n 4 +l 

n 

m=l 


-a t 
. m 


Tv+T" 

n 

q=l 

q*m 


(a. 


a ) 
nr 


Most of the terms inside the braces are set to zero by the approximation that 
the exponential of a large negative number is nearly zero. That is. 


-at 

m 


n 4 +l 
n (a 
q=l ( 
q*m 


a m> 


- 0 


for l^m_< n 3 . Still working inside the braces, the denominators of the 
remaining terms are simplified by the approximation that a very large number plus 
or minus a very small number is nearly equal to the very large number. That is. 



p q 1 £ q 1 ni 

{ 6 q n i +1 < q < °2 

6 q + p q n 2 +1 1 q 1 n 3 


By the approximations above 


W 1 * 


n l n 2 n 3 

n n 6. n 6. 

i=l j = n^ +1 k=n 2 +l 


n u 

t=n 3 +1 


X 


n 4 +l 

{ £ 

m=n 3 +l 


n l n 2 

n p. n 6. 

i=l 1 j^+l 1 



t 


n 3 

n 

k=n 2 +l 



+ p k > 


n 4 +l 

n 

q=n 3 +1 
q*m 
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Since the first three products in the denominator do not involve the index of 
summation m, they may be pulled outside the summation. 


n i n 2 5- n 3 6. 

- » (r 1 ) n U) n 3 fc-i— ) 

1*1 p i j»n 1 +1 5 j k=n 2 +1 s k + p k 


04 n4+l 

x n \ x { z 

A=n 3 +1 m=n 3 +l 


-at 

m 


n 4 +l 

n ( a a 
q=n 3 +l q 

q*m 


a m> 


The last two factors are the exact solution of the Markov model 


. x +1 

r n,+l Y n 3 





V 1 




where all A's and y's are small. The first nonzero term of the matrix Taylor 
series solution is 


/ * ,t n *» " n 3 " 1 

»=J 3+ 1 X ‘ ( T"4 - "3 - l)! 1 


Hence, the final approximation is 


„ , . , n i Y n 3 ^ ^n 4 - n 3 - 1 

ntl * " A p 7 > ( ki + i ( tA + l ( T5T - "3 - !)!> 
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